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Abstract 



To model printing noise a binary noisy channel and a set of controlled gates are introduced. 
The channel input is an image created by a halftoning algorithm and its output is the printed 
picture. Using this channel robustness to noise between halftoning algorithms can be studied. 
We introduced relative entropy to describe immunity of the algorithm to noise and tested 
several halftoning algorithms. 

1 Introduction 

Printing is a complicated process that can be considered from the numerous points of view. In 
Hterature it is payed more attention to halftoning, a process that creates a binary image to re- 
produce it as a continuous-tone picture by a binary printing device [1,. The goal of all halftoning 
techniques is to generate an image that is perceptually similar to the original. To estimate the 
original and printed image, a large number of distortion measures and criteria based on the models 
of the human vision system have been proposed [2J . Absence of the universal solutions stimulates 
progress in these fields. 

In this paper we consider a printing process as a communication channel that transforms a 
halftoned image into a printed image. We are interested in the main question can the noisy channel 
be suitable to describe errors in printing process? We introduced a binary channel, well known in 
theory of information [3], and a set of controUed-gates to model printing noise. We found that such 
simple noise of the binary channel as bit-flip and erasing noise introduce a visible distortion. The 
introduced noisy channel allows us to consider robustness of halftone images against to noise. By 
this way robustness between halftoning algorithms can be studied. Immunity to noise is important 
because it provides the quality of the printed images. Noise has a physical nature and results in 
errors in printing always. However one can reduce errors if one chooses a halftoning algorithm such 
that its immunity to noise is large. 
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2 Binary channel for printing 

Any printing device has binary output, if a dot is printed or not. From the point of view of the 
theory of information the printing process can be considered as transmitting information trough a 
binary channel with noise that can model errors of printing. 

To introduce the binary channel for printing, we begin with the general scheme of Shannon |3] 
for transmitting and storing information. The scheme has a source of information whose output, 
a message, is transformed by a coder into a signal acceptable for sending through the channel or 
storing it in a memory device. The channel has a noise source that describes errors due to its 
physical nature. In the output of the channel a decoder transforms the message into the signal 
suitable for the receiver. Considering printing one can find the similar organization, shown in 
Fig. [T] . Here the source of information is a digital grayscale image. By halftoning the image is 
transformed into a binary one, that is input of the printing binary channel. This channel consists 
of "ink" and "paper". Output is a printed image addressed for the receiver. The receiver plays 
an important role, his features are very complicated and we will ignore him. So the introduced 
scheme is not perfect but we think this scheme may be sufficient to model printing process. 

The binary channel transmits strings of and 1 generated by the printing device whose main 
elements are "ink" and "paper". The terms "ink" and "paper" are conventional. They can be a 
usual ink and paper, when the image is presented by an usual way. Also, one can find electronic 
paper or inks. Anyway the methods of reproducing halftone or colored image have the similar 
features. 

3 Binary noise 

The binary channel has a binary noise. To model numerous sources of noise in printing process by 
the binary channel a set of controlled gates can be suitable. 

Because of the noise zeros and ones can be transmitted incorrectly from input to output. It 
results in information loss and decreasing capacity of the communication channel. For printing it 
means a degradation of the image quality. Two main types of noise are known as bit-flip 0—^1, 
1 — 0, and erasing {0; 1} — > 1. They occur with some probability p. For example, if the bit-flip 
error has p = 1/2 then the channel capacity is zero and information can't be transmitted. There 
are numerous noise sources in printing process. For example, consider a printing head, or more 
generally the printing devices. They have to produce an ink dot of a flxed size in a given position. 
Let introduce a simple vibration, it affects on the printing head and the head makes errors. Then 
one can flnd an unnecessary dot, a dot in the unwanted position also the dot size may be increased 
and so on. 

The observations tell that in printing process the noise can be described mathematically by 
conditional operations C-U, known in the computer literature |4] . The C-U gate or controlled 
gate, has two inputs and two outputs named as control and target. The gate works as follows. If 
and only if the control bit is 1, then operation U is applied to target. Let x G {0; 1} be a control 
bit and ?; be a target input, then C-U maps x ® y ^ x ® U^y. By this way one can describe any 
noise, particular the vibration of the printing head, assuming a; be a random string of and 1 and 
U be an appropriate operation. In more general case both the control and target signal can be n-d 
arrays. If we wish to describe processing image then n~2 and it needs 2d-binary noise. 

We generated binary noise by a simple way with the help of threshold halftoning. Let r be 
a random matrix, a 8-bit grayscale image. Let the probability distribution function of lightness 
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r[m, n] — 0, 1, .., 255 be uniform. Then binary matrix is obtained like that 

v[m, n] 



1, if r[m, n] < T; 
0, ifr[m,n]>T, 



where T is a threshold. It follows from this equation that in matrix v the number of ones is 
proportional to threshold T so we will name T power of binary noise. Fig. [2] shows some results 
on binary noise and its entropy, presented as functions of T. Perceptually noise refers to lightness 
of the image. The image looks more black when power increases. Due to random matrix r entropy 
of binary noise is a random function of T and it needs averaging. In Fig. |2] (c) entropy has 
been calculated by averaging over 1024 realizations of r. Note, entropy achieves its maximum at 
T = 0.5 because this threshold results in matrix v that has zeros and ones generated uniformly 
with probability close to 1/2. 

Erasing noise {0, 1} — ?> 1 can be modeled by a C-U gate with 2d input. Let the control signal be 
the binary noise v and let input target signal be a halftoned image g. Then x = v[to, n], y = g[m, n] 
and the C-U gate accomplishes the task, if U^y = x\/y, where V is disjunction. This noise increases 
number of the black dots at printed image. An example of erasing is shown in|3](a,b,c), noise results 
in distortion of contour. A more exact erasing noise can process a block Kg of binary image. Let 
one of the pixels, g[m, n] e Kg, be transformed into 1 by erasing noise, if and only if the center 
pixel of the block g[mc,nc] — 1. For this case input of the C-U gate is x — v[m, n] (8) g[mc,nc] 
and y = g[TO,n]. The gate accomplishes the task, if XJ^y — v[m, n] A g[77ic,nc] V y, where A is 
conjunction. This noise may lead to blooming and smearing of image as it is shown in Fig. [3]^d,e,f). 



4 Robustness to noise 

By considering distortion of a halftoned image due to noise one can learn about its robustness to 
noise. If the image is created by a halftoning algorithm, then one can study robustness of the 
algorithm. 

Let a halftoned image g be transmitted trough a channel with binary noise v of power T and 
g' be the output noisy image. To describe distinction between g,v,g' we introduce two measures 
of distortion, euclidian distance and relative entropy. Both measures maps pairs of images given 
by matrices A and B into [0,oo). 

Euclidian distance between two matrices is denoted by e(A, B) = {{^/n)'^^ ^{A[m,n\ — 
B[to, n])^}^/^, where n is the number of elements of matrices. This is an average distance between 
matrices. It describes how much images A and B are close, the more euclidian distance the more 
discrepancy between images. But this is a mathematical measure and it may be not in accordance 
with visual perception. To examine a halftoned image g obtained by D-algorithm introduced in 
our work jS] has been chosen. We calculated euclidian distance e(v, g) between binary noise and 
halftone image and found that it increases monotonically with power noise T, Fig. |4](a). It means 
that the binary noise of maximally power is maximally closer to image g. It doesn't correspond to 
visual perception and this is one of the reasons to consider relative entropy. 

In statistics the relative entropy known also as Kulback-Leibler entropy is used to establish the 
difference between two distributions of a random variable. For images A and B it is defined as 
Q{Pa\\pb) = J2iPA[i]{'^ogpA\i]-'^ogpB[i\), where pA\i], PB[i\) are histograms of lightness i 0, 1, ... 
The relative entropy is not negative and Q{pa\\pb) = if and only Hp a = Pb- The relative entropy 
is not a metric because it is in general not symmetric Q{jpa\\pb) Q{pb\\pa) and does't satisfy the 
triangle inequality. It is nevertheless often used in image processing, particular in steganography 
and digital watermarking f5] . 
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We calculated the relative entropy Q(g||v) between the considered above halftone image g and 
binary noise. It is shown in Fig. |4] (b) versus the noise power T. As it is seen the function 
(3(g||v) has its minimum at T = 0.7 and increases if power noise moves off 0.7. The minimum tells 
that histograms of g and v are very close, if T = 0.7. This is a mathematical fact and it is not 
accordance with the human vision. We think the reason is that these images have a quite different 
semantic information that can't properly be described by relative entropy. Clear, that from the 
semantic point of view two images g and g' are more "closer", than g and noise v. Indeed, we 
calculated the relative entropy Q(g||g') that increases monotonically with the noise power T (Fig. 
|4](c)). This is an evident fact because noise introduces a difference in histograms and what is more 
important this is in accordance with human vision. 

Taking into account observation about semantic information we will use the relative entropy 
for comparative studies of robustness to noise between halftoning algorithms. This choice is also 
based on the next statement. The relative entropy can describe an expert estimation of the quality 
of the image. 

Let g and g' be input and output image of the binary noisy channel and g be obtained by 
a halftoning algorithm a. We will name the algorithm a e-robust to noise, if relative entropy 
Q(g||g') ^ £• The algorithm is perfect, if (5(g||g') = 0. The introduced definition tells that the 
smaller e is, or the closer the histograms of g and g' are, the greater robustness of algorithm is. To 
better understand what is meant by e-robustness consider that an expert examines the quality by 
viewing images g and g'. Let the expert have to answer the question, is the given image g or g'. 
When e is small he can make two types of errors. So the expert can decide that the given image 
is g, when it fact it is g' and vice versa. This detection scheme is well known in statistical signal 
detection and estimation [7]. Let probability of the expert errors be a and /3. Then, if only g and, 
if only g' is shown to expert, the relative entropy between his decisions is (3(a||/3). Because the 
expert with his decisions is a type of processing and processing can't increase relative entropy for 
e-robust algorithm one finds 

Q(a||/3)<Q(g||g')<e. 

As it follows from this equation e-robustness of algorithm refers to errors of the expert, that tests 
the image quality. 

The relative entropy can be used to compare robustness to noise between halftoning algorithms. 
Let gfc be an image obtained by a halftoning algorithm a^, fc = 1,2,... and let g\ be its noisy 
version. One can calculate the relative entropies = Q(gk||gk)- Algorithm a^ is more robust 
than at, if q^. < q^. In practice this inequality may hold in some region of parameters and for 
certain types of images because there are not ideal halftoning algorithms. 

As example we studied some algorithms. First is DITHER, it is based on the the Floyd- 
Steinberg error diffusion method and can be evaluated as dither (I) in MATLAB. Second is 
D-algorithm, it has an input parameter h that denotes a grayscale h x h block processed (3- We 
calculated the relative entropy between DITHER and D-algorithm, qi and q2 for bit-flip noise. 
Fig. |5] shows difference qi — q2 as function of the power noise T and size block h. It follows that 
there is a range, h > 25, where q2 < qi- It this range D-algorithm is more robust against noise. 
Fig. |6] illustrates distortions introduced by noise in halftone images obtained by D and DITHER 
techniques for T — 0.2 and h — 19,^2 < Qi- One can see that distortions are more noticeable in 
the DITHER techniques, that is in agreement with mathematical results. The results presented at 
Fig. [5] and Fig. [6] are valid for an image only and it needs a large set of images for investigation. 
Clear, that a given halftoning algorithm can't processes properly all possible images. Then there 
is a problem to find a suitable class of images. One of the solutions is presented at Fig. [7j It 
shows relative entropy of eight halftining algorithms versus power of noise. We used seven original 
halhtoning algorithms DOTDIF, ERRDIF, LAU, ULICHNEY, CDOTl, CD0T2, BAYER from [1 and D 
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algorithm. Each point at Fig. |7]is averaged over 80 images from the famous collection Caprichos 
by Goya. Indeed, there is a monotonic behavior that tells that relative entropy of D algorithm is 
the least. It means, for example, that to print Caprichos D algorithm may by more preferable. 
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Figure 1: Binary channel for printing. Input halftoning image is transmitted trough the channel, 
a printing device, which output is a printed image. 
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Figure 2: Binary noise and its properties. Random binary pattern obtained by a threshold halfton- 
ing vs threshold T, that is power of noise (a) and (b), entropy of binary noise (c). 
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Figure 4: Euclidian distance and relative entropy vs power of noise. Euclidian distance between 
halftone image and binary noise (a), relative entropy between halftone image and binary noise (b), 
relative entropy between halftone image and noisy image (c). 
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Figure 6: Distortion introduced by bit-flip noise with power T = 0.2. Halftone images created by 
DITHER (left) and D-algorithm (right), h — 19, their noisy versions at the bottom. 
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Figure 7: Relative entropy overaged over 80 images. Seven halftoning algorithms DOTDIF, ER- 
RDIF, LAU, ULICHNEY, CDOTl, CD0T2, BAYER show very close results, blue curves. The 
eighth algorithm D is distinguished, red curve, its relative entropy is least. 
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